† Corresponding author. E-mail:
Project supported by the National Natural Science Foundation of China (Grant Nos. 61332003 and 61303068) and the Natural Science Foundation of Hunan Province, China (Grant No. 2015JJ3024).
Memristive technology has been widely explored, due to its distinctive properties, such as nonvolatility, high density, versatility, and CMOS compatibility. For memristive devices, a general compact model is highly favorable for the realization of its circuits and applications. In this paper, we propose a novel memristive model of TiOx-based devices, which considers the negative differential resistance (NDR) behavior. This model is physics-oriented and passes Linn’s criteria. It not only exhibits sufficient accuracy (IV characteristics within 1.5% RMS), lower latency (below half the VTEAM model), and preferable generality compared to previous models, but also yields more precise predictions of long-term potentiation/depression (LTP/LTD). Finally, novel methods based on memristive models are proposed for gray sketching and edge detection applications. These methods avoid complex nonlinear functions required by their original counterparts. When the proposed model is utilized in these methods, they achieve increased contrast ratio and accuracy (for gray sketching and edge detection, respectively) compared to the Simmons model. Our results suggest a memristor-based network is a promising candidate to tackle the existing inefficiencies in traditional image processing methods.
With the coming era of the big-data, the size of produced and stored data in 2020 is expected to approach 44000 exabytes (
The memristor, which was first fabricated in Hewlett Packard (HP) Labs in 2008,[4] has the potential to break the efficiency bottleneck of image processing applications. It is a two-terminal passive device that has several distinctive properties, such as scalability, nonvolatility, and high density, which make it a promising candidate for future memory.[5,6] Its capability not only to function in the analog space with neural networks, but also to act as a form of binary storage in traditional computation means it has significant potential to tackle many future computing problems.[7–9]
The availability of highly accurate, general and predictive memristive models is crucial for investigation of nonlinear dynamics of memristor-based circuits.[10,11] Memristive models, usually represented by differential equations that are directly available for circuit simulations, define specific methods to compute the responses to a given stimulus. To date, several models have been reported.[12–18] It is necessary to compare, evaluate, and classify them in advance in order to quickly select an appropriate model for a specific application. Recently, Linn et al.[19] reported three experiment-based criteria that can be used to evaluate the quality of two classes of models. The first class of models are linear ion drift models, which build upon Strukov’s initial memristive model[4,20] with different window functions, but have limited predictability due to the nonlinear traits of the switching kinetics.[19] The second class are physics-oriented models, represented by the Simmons,[13] Chang’s,[15] and Yang’s[17,21] models, which successfully pass Linn’s criteria. From the perspective of a circuit designer, a model should be efficient enough to reflect various properties of devices with a few simple functions. However, existing models are a trade-off between complexity and accuracy. The Simmons model is accurate, but too complex for circuit design. Chang’s and Yang’s models are computationally efficient, but not accurate enough. Another deficiency of these models is their neglect of some physical phenomena, such as negative differential resistance (NDR),[22] long-term potentiation (LTP), and long-term depression (LTD) behaviors.
In this paper, an experiment-based memristive model that is accurate and computationally efficient for circuit design is proposed, which passes Linn’s criteria and can also describe the NDR and LTP/LTD behaviors. As compared to the memristive models previously reported, it achieves lower latency (below half the VTEAM[16] model) and preferable generality without sacrificing accuracy. On the basis of memristive models, we propose novel methods for gray sketching and edge detection operations, which can greatly enhance the efficiency by avoiding the time-consuming calculations of complex nonlinear functions. The proposed model is verified to surpass the Simmons model for the aforementioned image processing applications, and our results suggest that a memristor based network may provide a new solution to tackle the efficiency problem of image processing.
The rest of the paper is organized as follows. Section
TiOx-based memristors are prototypical for valence change mechanism (VCM) devices[23] whose resistive switching behavior is attributed to the formation and dissolution of oxygen-deficient filaments in transition metal oxides.[24] To examine this behavior first hand, an Au/Ti/TiO2/Au memristor-based crossbar array (
Detailed device fabrication methods and experimental tests were presented in our previous work.[25,27]
Generally, a voltage-controlled memristive system[28,29] is represented by
An available memristive model should abstract, parametrize, and predict the behaviors of devices under a given stimulus. In this section, we propose a novel memristive model and compare it with previously reported models in respects of accuracy, complexity, and predictability.
In the practical case, the charged mobile ions (e.g., oxygen ions in TiO2) would drift under the influence of the electric field, leading to variations of the inner state variable. The relationship between electric field intensity and moving speed of ions is not linear, but always exponential. In addition, due to the high mobility of oxygen vacancies, diffusion effects of the charged mobile ions should be considered as well.
On the basis of various experimental tests and analysis, Chang’s model[15] defines the inner state variable by integrating the drifting and diffusing effects in a single equation. We define the inner state variable in a similar way as
However, a memristive device may not only exhibit these effects; in this case, the contributions of the NDR behavior should not be ingored. At low resistance states, conductive filaments (CF) have formed in transition metal oxides of memristive devices. When joule heating of the devices is excessively high, it may lead to gradual ruptures of the filaments.[22,30] This morphological variation of the filaments would then raise the resistances of the devices, removing the NDR behavior as the device generates less heat and the joule heating dissipates. Therefore, the NDR behavior is related to the history of electric field applied to the devices and may only exist at some interval of integrated external electric field. In order to model this behavior, we introduce a thermal variable E
For TiOx-based devices, a Schottky barrier is always formed between titanium oxide film and the bottom layer, while an electron tunneling layer always develops when a positive voltage is applied to the top layer. To integrate these two effects, we define I–V equation as follows:
The proposed model is distinctive. The Simmons model uses a tunneling junction with a series resistor to model a memristive device. The inner state variable (X) of the model describes the width of the tunneling junction. In contrast, X of the proposed model represents an area index, i.e., the number of CFs or the area of the conductive region. Hence, these two models have different X descriptions. The proposed model is also different from Chang’s model. They have different formula expressions of X and different I–V functions. The proposed model considers the NDR behavior, and uses two functions to describe the asymmetric electrical properties under both polar input voltage signals.
A distinct characteristic of a memristive device is that its resistance can be controllably changed by a given electrical stimulus. The device can achieve a low resistance state (LRS) under a positive stimulus, while a high resistance state (HRS) can be obtained under a negative stimulus. The transition from LRS to HRS is called a “RESET” process, and the transition from HRS to LRS is called a “SET” process.
A memristive model is a dynamical system that can be used to predict device behaviors under any given input stimulus. The proposed model does not have any current or voltage threshold, because models with built-in fixed thresholds (currents or voltages) are not general enough and always lack predictability.[19] Though there are thermal thresholds accounting for the NDR behavior, they are dispensable when a memristive device does not exhibit this behavior. In the following analysis, we evaluate the proposed model with three strict criteria using Matlab. The parameters of the proposed model in this simulation are in the second colomn of Table
The first evaluation criterion is that, for a reasonable model, it should have the ability to predict the distinct I–V characteristics of a memristive device. Typically, there are four characteristics: an abrupt current increase during the SET process, a gradual RESET process of the VCM-based memristive devices, an I–V-plot that is asymmetric about the origin, and an observed increase in both SET and RESET voltages with a higher sweep rate. In Fig.
The second evaluation criterion is that, during fixed-voltage pulse tests, the relationship between SET time
The third evaluation criterion can be validated by simulating the CRS behavior through two devices connected anti-serially. Theoretically, any change of the state variable of one device can be offset by the other one so that the resistance of the combined cell is constant. In Fig.
Ideally, a memristive model should reflect experimental data while being as fast and simple as possible. To compare the accuracy and complexity between the proposed model and the reference models, we fit these models to measured data by adjusting their parameters to minimize error functions.
To perform the fitting, we use Gradient Descent[36] and simulated annealing algorithms[37] to minimize the relative error function value. To reduce the possibility of local convergence of a single error function, we use two different error functions: the first error function is relative root mean squared error (RMS) as
During each fitting procedure, two related parameters are iterated and adjusted to minimize the error functions in Eqs. (
In Fig.
To test the generality and predictability of the proposed model, we fit the model to the reference models while keeping the original parameters of the reference models constant. The proposed model is further fit to measured data of two frequently-used devices to verify its predictability: an HfOx-based device[38] and a TaOx-based device.[39]
The fits of the proposed model to the aforementioned reference models and devices are shown in Fig.
The conductance variation of memristive devices is analogous to the behavior of synapses in neuromorphic systems. In other words, the memristive conductance is gradually enlarged or reduced by applying consecutive positive or negative pulses, giving rise to long-term potentiation/depression (LTP/LTD). If a memristive model is valid, it should have the ability to predict the LTP and LTD behaviors of the devices. In this subsection, we focus on the simulation of the LTP/LTD behavior under consecutive fixed-voltage pulses with different pulse widths to compare the validity of the memristive models using Matlab.
In Fig.
The experimental data of the HfOx-based[38] and other memristive devices previously reported[15,40–42] have shown that the change rate of the conductance tends to be smaller as the device approaches the HRS and LRS states in depression and potentiation operations, respectively. In Fig.
The models exhibit three common characteristics. First, the conductance of the models is not linearly related with the number of voltage pulses. Second, for both depression and potentiation operations, as the pulse width gets larger, fewer numbers of pulses are needed to switch the states. Finally, for the depression operation, as the models approach their LRS states, the change rate of the conductance gets smaller. These characteristics are consistent with the device behaviors in experimental tests.[15,40–42] On the other hand, the models have their distinct traits: to begin with, for the proposed and the Simmons models, the numbers of pulses needed in the potentiation operations are relatively fewer than the ones in the depression operations, which accords with the fact that the potentiation operation is always abrupt, whereas the depression operation is gradual for a VCM-based RRAM cell. However, Chang’s and Yang’s models do not obviously reflect this fact. Next, for the proposed and Chang’s models, when approaching their LRS states in the potentiation operation, the change rate of the conductance gets smaller, while the Simmons model and Yang’s model do not follow this principle. Finally, the proposed, Simmons, and Yang’s models exhibit an obvious nonlinearity in the depression operation, while Chang’s model is almost linear at each pulse width.
In this simulation, the proposed model most effectively predicted the LTP/LTD behaviors of the device, followed by the Simmons model, Chang’s model, and then Yang’s model. Though these reference models have passed Linn’s criteria,[19] they are not effective enough to predict the LTP/LTD behavior.
For most memristive devices, the depression operation is a gradual, controllable process. This gradual LTD behavior can be used to process grayscale images. The conductance of the device represents the gray level of a pixel. In the following subsection, we implement grayscale image processing applications based on the proposed and the Simmons models.
Image processing is a data-intensive application which requires massive calculation and high efficiency. By exploiting application-specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs), the efficiency of image processing can be significantly enhanced, but still cannot satisfy the requirements of many applications, e.g., real-time video monitoring, large-scale image retrieval and multi-target tracking.[3,43] In this subsection, we explore gray sketching and edge detection based on memristive models using Matlab. In Fig.
Gray sketching is a basic gray level transformation to enlarge gray level dynamic range that can be divided into linear and nonlinear transformation methods. The former transformation is always oversimplified and not effective, whereas the latter tends to be complex and time-consuming. Here, we propose a novel nonlinear transformation approach, which does not require the calculation of standard deviation or other complex nonlinear functions, and therefore can greatly enhance the efficiency of the transformation. The approach consists of four steps: first, calculate mean gray level
In Fig.
The new method avoids time-consuming calculation of the complex nonlinear functions required by common nonlinear transformation method and it may further save time due to its physical hardware implementation.
Edge points are important features both in image processing and computer vision fields, which represent sudden gray level variations. Here, we propose a novel method which utilizes the LTD behavior based on memristive models to perform edge detection operation. Similar to the method discussed in the previous subsection, the proposed method avoids the calculation of complex functions and is highly efficient.
For two adjacent pixels in a grayscale image, first, we calculate the absolute difference
In Figs.
Further comparisons of the memristive models in edge detection at different voltage thresholds are shown in Figs.
The types and colors of the lines in Fig.
Consequently, the new method based on the proposed model exhibits better detection results over the same method based on the Simmons model. Our method locates the edge points efficiently with continuity and accuracy, and therefore can be a template for how to tackle the efficiency problem of image processing using a memristor-based network.
A novel experiment-based memristive model has been presented which considers the drifting effect, the diffusing effect, and the NDR effect. This physics-oriented model was obtained after extensive study of the physical mechanisms of fabricated TiOx-based devices. The proposed model passes Linn’s criteria, and the characteristics of flexibility, generality and accuracy have been fully verified.
The proposed model along with memristive models previously reported has been fit to experimental data by tuning the parameters to minimize RMS and TAE error functions. During this fitting, the proposed model without NDR has higher accuracy and efficiency compared to the memristive models previously reported. Further, the proposed model exhibited high generality and accuracy when fitted to the HfOx-based device, TaOx-based device, and the memristive models previously reported.
A prediction of LTP/LTD behavior in memristive device has been simulated based on memristive models, which could be an additional evaluation criterion of Linn’s criteria. A higher predictability of the LTP/LTD behavior of the proposed model over the previous memristive models has been discovered.
Finally, based on the LTD behavior of the memristive models, two novel methods have been proposed to implement gray sketching and edge detection, which have greatly enhanced the efficiency by avoiding time-consuming calculation of complex nonlinear functions. Simulation results reveal the considerable potential for the memristor-based network to enhance the efficiency of image processing. Limited by the poor yield rate of the fabricated devices and the device-to-device variations, the physical implementation of the memristor-based network has not been completed yet and is left as a future work.
[1] | |
[2] | |
[3] | |
[4] | |
[5] | |
[6] | |
[7] | |
[8] | |
[9] | |
[10] | |
[11] | |
[12] | |
[13] | |
[14] | |
[15] | |
[16] | |
[17] | |
[18] | |
[19] | |
[20] | |
[21] | |
[22] | |
[23] | |
[24] | |
[25] | |
[26] | |
[27] | |
[28] | |
[29] | |
[30] | |
[31] | |
[32] | |
[33] | |
[34] | |
[35] | |
[36] | |
[37] | |
[38] | |
[39] | |
[40] | |
[41] | |
[42] | |
[43] | |
[44] | |
[45] | |
[46] |